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Evolutionary game theory has been successlully used to investigate the dynamics of systems, in 
which many entities have competitive interactions. From a physics point of view, it is interesting 
to study conditions under which a coordination or cooperation of interacting entities will occur, be 
it spins, particles, bacteria, animals, or humans. Here, we analyze the case, where the entities are 
heterogeneous, particularly the case of two populations with conflicting interactions and two possi- 
ble states. For such systems, explicit mathematical formulas will be determined for the stationary 
solutions and the associated eigenvalues, which determine their stability. In this way, four different 
types of system dynamics can be classified, and the various kinds of phase transitions between them 
will be discussed. While these results are interesting from a physics point of view, they are also 
relevant for social, economic, and biological systems, as they allow one to understand conditions for 
(1) the breakdown of cooperation, (2) the coexistence of different behaviors ("subcultures"), (3) the 
evolution of commonly shared behaviors ("norms"), and (4) the occurence of polarization or conflict. 
We point out that norms have a similar function in social systems that forces have in physics. 



I. INTRODUCTION 

Game theory is a theory of interactions, which goes 
back to von Neumann [2] , one of the superminds of quan- 
tum mechanics. It is is based on mathematical analyses 
[3H6] and methods from statistical physics and the the- 
ory of complex systems [7HTT], while applications range 
from biology [31 [OJ over sociology [T^HTo] to economics 
fTBlll8| . Physicists have been particularly interested 
in evolutionary game theory [3H3 [13j [19] , which focuses 
on the dynamics resulting from the interactions among 
a large number of entities. These could, for example, be 
spins, particles, bacteria, animals, or human beings. For 
such systems, one can calculate the statistical distribu- 
tion of states in which the entities can be. These states 
reflect, for example, the location in space [501 HI] and/or 
whether a spin is oriented "up" or "down" [22l [23] , while 
in non-physical systems, the states represent decisions, 
behaviors, or strategies. In such a way, one can study 
problems ranging from the spontaneous magnetization 
in spin glasses [22l [23] up to the emergence of behav- 
ioral conventions [55] • Further application areas 
are nucleation processes [2H1 HZ] , the theory of evolution 
[s2 rjSHSl], predator-prey systems [31] EH] and the sta- 
bility of ecosystems [32-35 . Physicists have also been 
interested in the effects of spatial interactions [36Tf38] or 
network interactions [MSS], of mobility [201 (2D H7H5T] 
or perturbations [2U IBTHSl] . 

Recently, particular attention has been paid to the 
emergence of cooperation in dilemma situations [6l 155] , 
which arc reflected by a number of different games char- 
actarized by different types of interactions g] : In the stag 
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hunt game (SH), cooperation is risky, in the snowdrift 
game (SD), free-riding ("defection") is tempting, while 
both problems occur in the prisoner's dilemma (PD) |38j . 
Details will be discussed in Sec. IIVBI Most of the re- 
lated studies have assumed homogeneous populations so 
far (where every entity has the same kind of interactions) . 
Here, we will study the heterogeneous case with multi- 
ple interacting populations. Compared to previous con- 
tributions for multiple populations [H [2H [50H55] , we will 
focus on populations with conflicting interests and dif- 
ferent power. Furthermore, we will classify the possible 
dynamical outcomes, and discuss the phase transitions 
when model parameters cross certain critical thresholds 
("tipping points"). 



Our paper is structured as follows: Section [TT] intro- 
duces the game-dynamical replicator equations for mul- 
tiple interacting populations. Afterwards, Sec. (TTS] spec- 
ifies the payoff matrices representing conflicting interac- 
tions. While doing so, we will take into account the (po- 
tentially different) power of populations. Then, Sec. Ill 
derives the stationary solutions of the evolutionary equa- 
tions and the associated eigenvalues, which determine the 
instability properties of the stationary solutions. This is 
the basis of our classification. Section IIVI collects and 
discusses the main results regarding the dynamics of the 
system and possible phase transitions when model pa- 
rameters are changing. It also offers an interpretation of 
the formal theory. Finally, Sec. [V] presents a summary 
and outlook. 
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II. GAME-DYNAMICAL REPLICATOR 
EQUATIONS FOR INTERACTING 
POPULATIONS 



In the following, we will formulate game-dynamical 
equations for multi-population interactions [4l [24l [56H58] . 
For this, we will distinguish different (sub-)populations 
a,b,c € {1, . . . ,.4} and various states (behaviors, strate- 
gies) i, j, k <E {1, . . . , /}. If an entity of population a char- 
acterized by state i interacts with an entity of population 
b characterized by state j, the outcome ( "success" ) of the 
interaction is quantified by the "payoff" Af-. Now, let 
fa > with J2 a /a = 1 be the fraction of entities belong- 
ing to population a and pf(t) > with J^pf (i) = 1 the 
proportion of entities in population a characterized by 
state i at time t. We will assume that entities take over 
(copy, imitate) states that are more successful in their 
population in accordance with the proportional imitation 
rule [241 159j . Moreover, when the interaction frequency 
with entities of population b characterized by state j is 
fbp b j (i.e. proportional to the relative size or "power" /b of 
that population and the relative frequency p b of state j in 
it), we find the following set of coupled game-dynamical 
equations [2"4"] : 



dpm 

dt 



=Pt(t)[Em-Mt)] 



Herein, the "expected success" 

6=1 j = l 



(1) 



(2) 



of entities belonging to population a characterized by 
state i is obtained by summing up the payoffs Aff over all 
possible states j of interaction partners and populations 
6, weighting the payoffs with the respective occurrence 
frequencies f b p){t). (Note that £ 6 Ej hp)[t) = 1.) The 
quantity 



k=l 



is the average success in population a and 



A 



(A)=J2faA a (t) 



(3) 



(4) 



the average success in all populations. The above game- 
dynamical equations assume that population sizes (and 
the population an entity belongs to) do not change. 

Comparing the above game-dynamical equations with 
the usual replicator equation for the one-population case, 
we have additional terms involving payoffs Af b from in- 
teractions with different populations b ^ a. They lead to 
a mutual coupling of the replicator equations ([!]). Asym- 
metrical games with different payoff matrices of the in- 
teracting entities, or games between entities with differ- 
ent sets of states (strategy sets) are examples for the 
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Figure 1: (Color Online) Illustration of the outcomes of sym- 
metrical 2x2 games as a function of the payoff-dependent 
parameters b a — B and c a = C, if / = 0.8 (i.e. 80% of in- 
dividuals belong to population 1) and if the entities interact 
within their own population, but different populations do not 
have any interactions between each other (B a — = C a ) 
[U [23] . p = p\ is the fraction of entities of population 1 in 
state 1 and q = p% the fraction of entities of population 2 in 
state 2. The vector fields show (dp/dt, dq/dt), i.e. the direction 
and size of the expected change of the distribution (p, q) of 
states with time t. Sample trajectories illustrate some repre- 
sentative flow lines (p(t), q(t)) as time t passes. The flow lines 
move away from unstable stationary points (empty circles). 
Saddle points (crosses) are attractive in one direction, but 
repulsive in another. Stable stationary points (black circles) 
attract the flow lines from all directions. Each color (grey 
shade) represents one basin of attraction. It subsumes all 
initial conditions (p(0),g(0)) leading to the same stationary 
point [yellow = (1,1), green = (1,0), blue = (0,1), red = (0,0), 
turquoise = (po,po) with po = + \C\)]. Solid red lines 

indicate the thresholds at which continuous ("second-order") 
phase transitions take place, i.e. at which the system behavior 
changes qualitatively (characterized by the appearance or dis- 
appearance of stationary points), while the stable stationary 
points change continuously when the parameters are varied. 
Dashed lines indicate an abrupt change of a stable station- 
ary point, i.e. a discontinous ("first-order") phase transition. 
For multi-population prisoner's dilemmas (MPD), we have 
B < and C < 0, and the final outcome is (p, q) = (0,0). 
For multi-population snowdrift games (MSD), we have B > 
and C < 0, and the stable stationary solution corresponds to 
a coexistence of a fraction po = |B|/(|B| + C|) of entities in 
one state and a fraction 1 — po of entities in the other. For 
multi-population harmony games (MHG), we have B > and 
C > 0, and the eventually resulting outcome is (1,1). Finally, 
for multi-population stag hunt games (MSH), we have B < 
and C > 0, and there is a bistable situation, i.e. it depends on 
the initial fraction of entities in a state, whether everybody 
ends up in this state or in the other one [23] . 
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need to distinguish between different populations. Within 
the framework of game-dynamical equations they can 
be treated as bimatrix games [3H5]. These, however, do 
not consider interactions among entities belonging to the 
same population ( "self-interactions" ) , which are reflected 
by the payoff matrices Afj. The above multi-population 
replicator equations include interactions both within the 
same population and between different populations. The 
significantly different dynamics and outcomes when in- 
teractions between two populations are neglected or when 
self-interactions are neglected become obvious when Figs. 
1 and 2 are compared with Fig. 3. 



When evaluating the expected success Ef(t), we will 



write the payoff matrices A?, for population a — 1 as 



<4?> - ( Z 2 



and (A]f) 



Ri Si 
T x P 1 



(6) 



A. Specification of Conflicting Interactions 

To reflect conflicting interactions, the payoffs in popu- 
lation a = 2 are assumed to be inverted ("mirrored"), i.e. 
state 2 plays the role in population 2 that state 1 plays 
in population f : 
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Figure 2: (Color Online) Illustration of the outcomes as a func- 
tion of the payoff-dependent parameters B a = B and C a = C, 
if / = 0.8 (i.e. 80% of the entities belong to population 1) 
and if the entities do not interact within their own popula- 
tion (b a = = Ca), while entities belonging to different pop- 
ulations have interactions with each other Small arrows 
illustrate again the vector field (dp/dt, dq/dt) as a function of 
p = p\ and q = p\. Black circles represent stable fix points, 
empty circles stand for unstable fix points, and crosses repre- 
sent saddle points. The basins of attraction of different stable 
fix points are represented in different grey shades (colors) [yel- 
low = (1,1), green = (1,0), blue = (0,1), red = (0,0)]. Solid red 
lines indicate the thresholds at which continuous phase tran- 
sitions take place, dashed lines indicate discontinous phase 
transitions. For multi-population prisoner's dilemmas (MPD), 
we have B < and C < 0, for multi-population snowdrift 
games (MSD), we have B > and C < 0, for multi-population 
harmony games (MHG), we have B > and C > 0, and for 
the multi-population stag hunt game (MSH), we have B < 
and C> 0. 

For reasons of simplicity and analytical tractability, we 
will now focus on the case of two populations (A = 2) 
with two states each (1 = 2). This allows one to reduce 
the number of variables by means of the normalization 
conditions fx = 1 — / 2 , p\{t) = 1 — p\(t) and p\(t) = 
1 — p\(t). Furthermore, we find 

El{t)-Ai(t) = El(t)- P \(t)E\(t)-[l-p\(t)]El(t) 
= [l-p\(t)][E\(t)-El(t)]. (5) 



(A 



21\ 



P2 T 2 
5*2 i?2 



and (A 



22 , 



P2 h 
S2 r 2 



(7) 



With the abbreviations p(t) = p\(t) and q(t) = p%(t), 
this leads to 

E\(t) = ri fp(t) + Sl f[l-p(t)] 

+ R 1 (l-f)[l-q(t)] + Si0.-f)q(t) (8) 

and 

E\(t) = hfp{t)+pxf[l-p{t)] 

+ Tl (l-f)[l- q (t)}+P(l~f)q(t). (9) 

The parameter / = fi represents the (relative) power of 
population 1, and (1 — /) = fa the power of population 
2. Inserting Eqs. Q and Q into Eqs. ^ and 0, the 
game-dynamical equation for population 1 becomes 



dp(t) 
dt 



p(t)[l-p(t)] F(p(t),q(t)) (10) 



saturation factors growth factor 

with F(p, q) = El — E\. Explicitly, we have 

F(p,q) = &i/+(c 1 -6 1 )/p+C 1 (l-/) + (S 1 -C 1 )(l-/)g, 

(H) 

where 

bi=s 1 -p 1 , c 1 =r 1 -t 1 , B 1 = S 1 -P 1) C 1 =R 1 -T 1 . 
The supplementary equation for population 2 reads 



dq(t) 
dt 



q(t)[l-q(t)} G(p(t),q(t)) (13) 



saturation factors growth factor 



with 



G(p,q)=b 2 (l-f) + (c 2 -b 2 )(l-f)q+C 2 f+(B 2 -C 2 )fp. 

(14) 

It is obtained by exchanging p and q, f and 1 — /, and in- 
dices 1 and 2. The first factors may be interpreted as sat- 
uration factors, as they limit the proportions p and q to 
the admissible range from to 1. The factors F(p, q) and 
G(p, q) can be interpreted as growth factors, if greater 
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than zero (or as decay factors, if smaller than zero). Note 
that the above two-population game-dynamical equa- 
tions are general enough to capture all possible 2x2 
games and even situations when entities of different pop- 
ulations play different kinds of games ( "asymmetrical" 
case). 



B. Special Cases 

If there are no interactions between entities of different 
populations, we have B a = = C a . In that case, both 
populations separately behave as expected in the one- 
population case (see Fig. 1 and Movie 1 [I]). Instead, if 
there are interactions between both populations, but no 
self-interactions, we have b a = = c a . In that situation, 
we end up with conventional bimatrix games (see Fig. 2 
and Movie 2 [TJ). In the following, we will assume that 
everyone has interactions with entities of all populations 
with a frequency that is proportional to the relative pop- 
ulation sizes. For simplicity, we will furthermore focus on 
the case where the payoffs depends only on the state, but 
not the population of the interaction partner. Then, we 
have p a = P a = P, r a = R a = R, s a = S a = S, and 
t a =T a = T, i.e. 

b a = B a = B = S-P (15) 

and 

c a = C a = C = R-T (16) 

(see Fig. 3 and Movie 3 1 ). If the interaction rate be- 
tween different populations is v times the interaction rate 
within the own population, we have the more general re- 
lationship B a = vb a = vB and C a — vc a = vC (where 
the parameter v > allows us to tune the interaction 
frequency between two populations — until now, we have 
assumed v = 1). In that case, we obtain 

F{p,q) = F v {p,q) = B [/(l - p) + v{l - f)q] 

" v ' 

>o 

+ C[fp + v{l-f){l-q)\ (17) 
s * ' 

>o 

and 

G(p,q) = G v (p,q) = B[(l-f)(l-q) + ufp] 

>0 

+ C[{1- f)q + uf{l-p)\ . (18) 

>o 

Note that one can restrict the analysis of the two- 
population game-dynamical equations to / > 0.5, as the 
transformations /■<->■ (1 — /) and p O q leave the two- 
population replicator equations unchanged. 



III. STATIONARY SOLUTIONS, 
EIGENVALUES, AND POSSIBLE SYSTEM 
DYNAMICS 

In the two-dimensional space defined by the variables p 
and q, the qualitative properties of the vector field (which 
determines the temporal changes dp/dt and dq/dt) can 
be completely derived from the stationary solutions and 
their stability properties, which are given by their eigen- 
values. These can be calculated analytically, i.e. there are 
exact mathematical formulas for them. 



A. Basic Definitions 

For an interdisciplinary readership, we will shortly de- 
fine some relevant terminology here, while specialists may 
directly continue with subsection B. A stationary solution 
(pi, qi) is defined as a point with dp/dt — and dq/dt = 0, 
which implies 

pi(l -pi)F(pi,qi) = and q t (l - qi)G(p t , q t ) = . 

(19) 

Besides calculating the stationary solutions, one may per- 
form a so-called "linear stability analysis", which allows 
one to find out how a solution 

(p(t) ,q(t)) = (pi + 8pi (t) , gi + Sqi (t) ) (20) 

in the vicinity of a stationary solution (pi,qi) evolves in 
time. If the distance 

di(t) = y/8pi(t) 2 +6 qi (t)* (21) 

goes to zero, which may be imagined as an attraction to- 
wards the stationary solution, one speaks of a stable sta- 
tionary point or an asymptotically stable fix point or an 
evolutionary equilibrium [13j (which is a so-called Nash 
equilibrium). Its basin of attraction is defined by the set 
of all initial conditions (p(0),q(0)), for which the trajec- 
tories (p(t),q(t)) starting in these points end up in the 
fix point under consideration as time t goes to infinity. 
(In Figs. 1-5 and Movies 1-3 [Tj, they are represented by 
different background colors.) 

If the distance di(t) grows rather than shrinks with 
time t, one speaks of an unstable fix point. This may 
be imagined like a repulsion from the stationary solu- 
tion. If the growth or shrinkage of the distance di is 
a matter of the specific choice of the initial conditions 
p(0) = Pi + Spi(0) and q(0) = qi + Sqi(t), the station- 
ary point is called a saddle point. A saddle point is at- 
tractive in one direction, but repulsive in another one. 
In Figs. 1-5 and Movies 1-3 [TJ, the stationary points 
and their respective stability properties (marked by cir- 
cles and crosses) have been determined analytically. They 
fit perfectly to the numerically calculated vector fields, 
which represent (dp/dt, dq/dt), i.e. the size and direction 
of changes in the distribution {p, q) of states with time. 
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Figure 3: (Color Online) Illustration of the parameter-dependent types of outcomes as a function of the payoff-dependent 
parameters B a — b a = B and C a = c a = C, if / = 0.8 (i.e. 80% of the entities belong to population 1) and if the entities have 
interactions with other entities, independently of the population they belong to. This corresponds to the multi-population case 
with interactions and self-interactions. Small arrows illustrate the vector field (dp/dt, dq/dt) as a function of p and q. Empty 
circles stand for unstable fix points (repelling neighboring trajetories), black circles represent stable fix points (attracting 
neighboring trajectories), and crosses represent saddle points (i.e. they are attractive in one direction and repulsive in the 
other). The basins of attraction of different stable fix points are represented in different shades of grey (colors) [red = (0,0), 
green = (1,0), blue = (0,1), yellow = (1,1), salmon = (u,0), mustard = (v, 1), where < u,v < 1]. Solid red lines indicate the 
thresholds at which continuous phase transitions take place, dashed lines indicate discontinous phase transitions. For multi- 
population prisoner's dilemmas (MPD), we have B < and C < 0, for multi-population snowdrift games (MSD), we have 
B > and C < 0, for multi-population harmony games (MHG), we have B > and C > 0, and for the multi-population stag 
hunt game (MSH), we have B < and C > 0. 



B. Calculation of the Stationary Solutions and 
their Eigenvalues 

We will now identify the stationary solutions (pi,qi) 
satisfying dp/dt = and dq/dt — and their respective 
eigenvalues A; and /i;. Using the notation p(t) = pi + 
5pi(t) and q(t) = qi + Sqi(t), the eigenvalues follow from 
the linearized equations 



d_ 
dt 



Spi(t) 

5qi(t) 



M 2 i 



Mia 
M 22 



S P i(t) 
Sqi(t) 



(22) 



with 

M u = (l-2p l )F(p l ,q l )+p l (l-p l ){c 1 -b 1 )f, 

M 12 = Pl (l- Pl )(Bi-Ci)(l- f), 

Mai = qi(l-qi)(B 2 -C 2 )f, (23) 

M 22 = {l-2q l )G{p h qi)+qi{l-q l ){c 2 -b 2 ){l- f). 

As the eigenvalue analysis of linear systems of differential 
equations is a standard procedure [13] , we will not explain 
it here in detail. We just note that the eigenvalues A; 
and /z/ of a stationary point (p;, qi) are given by the two 



(> 



solutions of the so-called characteristic polynomial 

(M u - Xi)(M 22 - w ) - M 12 M 21 = . (24) 

For the four stationary points (pi, q{) with I € {1, 2, 3, 4} 
discussed below, we have pi,qi € {0,1}, which implies 
M12M21 = 0. Therefore, the first associated eigenvalue is 
just 



Aj = M u = {l-2 Pl )F(jp uqi ). 
and the second associated eigenvalue is 

m = M 22 = (l-2qi)G( Ph qi). 



(25) 



(26) 



The following paragraph is again written for an inter- 
disciplinary readership, while specialists may skip it. If 
both eigenvalues are negative, the corresponding station- 
ary point (pi,qi) is a stable fix point, i.e. "trajectories" 
(p(t),q(t)) in the neighborhood (flow lines) are attracted 
to it in the course of time t. If A; and m are both positive, 
the stationary solution will be an unstable fix point, and 
close-by trajectories will be repelled from it. If one eigen- 
value is negative and the other one is positive, closeby 
trajectories are attracted in one direction, while they are 
repelled in another direction. This corresponds to a sad- 
dle point. If both eigenvalues are positive, closeby tra- 
jectories are repelled from the stationary solution. That 
situation is called an unstable fix point. 

Let us now turn to the discussion of the stationary 
solutions of Eqs. (10) and (13) with the specifications 



(11) and (14) 



• For the stationary solution (pi ,q%) = (0, 0), we have 
the associated eigenvalues Ai = b\f +C\(1 — /) and 
/ii = 6 2 (l-/) + C 2 /. 

• The point {p 2 , q 2 ) = (1,1) is also a stationary solu- 
tion and has the eigenvalues A2 = — [ci/+Bi(l — /)] 
andM2 = -[c 2 (l-/)+-B 2 /]. 

• The stationary solutions (^3,^3) = (1,0) and 
(P4>?4) = (0, 1) exist as well. They have the eigen- 
values A 3 = -[af+dil-f)], ^ 3 = b 2 (l-f)+B 2 f 
and A4 = 6i/ + J Bi(l-/),M4 = -[c 2 (l-/) + C 2 /]. 

• If < p k < 1 and < q k < 1 with 



P5 

P6 
<1« 



hf + 


Cx{l-f) 


(bi 


-ci)f 


bif + 


Bi(l-f) 


{h 


-ci)f 


b 2 (l- 


- f) + B 2 f 


(b 2 - 


02)(1-/) 


62(1- 


- /) + C 2 f 


(62- 


<*)(!- f) 



(27) 
(28) 
(29) 
(30) 



we additionally have stationary points (p5,q§) = 
(p 5 ,0) with F(p 5 ,0) = 0, (p 6 ,q 6 ) = (p 6l l) with 
F(pe,l) = 0, ( P7 ,q 7 ) = (l,q 7 ) with G{l,q 7 ) = 0, 



and/or (ps,qs) = (0,9s) with G(0,qs) = 0. These 
have the associated eigenvalues 

A 5 =P 5 (l-p 5 )(ci-&i)/, M5 = G(P5,0), (31) 
A6 =P6(1 ~Pe)(ci ~ h)f, n 6 = -G{p e ,l) , (32) 
A 7 = -F(l, q r ), M7 = q 7 (l- q7 )(c 2 -b 2 )(l-f) , (33) 

A 8 = F(0, 98 ), M8=58(l-98)(c2-6 2 )( 1 -/)- (34) 

• Inner stationary points (pg,<fo) with < pg < 1, 
< qg < 1 can only exist, if F(pg,qg) — = 
G(pg, qg) can be satisfied. 

C. Special Case of Homogeneous Parameters 

Let us now focus on the case of homogeneous param- 
eters given by b a = B a = B and c a = C a = C. In this 
case, the condition F(jpg, qg) = = G(pg, qg) for an inner 
point can only be fulfilled for B + C = 0. If B = — C, one 
finds a line 



q(p) = 



l/2 + /(p-l) 
l-f 



(35) 



of fix points, which are stable for B > 0, but unstable 
for B < 0. Otherwise, fix points are only possible on the 
boundaries with either p or q 6 {0, 1}. 

Evaluating the conditions < pi < 1 and < qi < 1 
reveals the following: 

• The stationary point (p$, 0) only exists for C < < 
B and / > \C\/{B + |C|) or for B < < C and 
f>C/(\B\ + C). 

• (p6,l) is a stationary point for C < < B and 
/ > B/(B + |C|) or for B < < C and / > 
\B\/(\B\ + C). 

• The stationary point (1, q 7 ) only exists for C < < 
B and / < \C\/(B + \C\) or for B < < C and 
/<C/(|B| + C7). 

• (0, <7g) is a stationary point for C < < B and 
/ < + |C|) or for B < < C and / < 
\B\/(\B\ + C). 

• If both, B and C are positive or negative at 
the same time, stationary points (pi,qi) with I € 
{5, . . . , 8} do not exist. 
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IV. OVERVIEW OF MAIN RESULTS 

For the special case with b a = B a = B and c a = 
C a = C, our results depend on the type of game, the 
sizes \B\ and |C| of the payoff-dependent model param- 
eters, and the power / of population 1 (e.g. its relative 
strength). They can be summarized as follows: For all 
values of the model parameters B, C, and /, all four 
corner points (0,0), (1,0), (0,1), and (1,1) are stationary 
solutions. However, if B > and C > 0, the only asymp- 
totically stable fix point is (1,1), while for B < and 
C < 0, the only stable fix point is (0,0). In both cases, 
(1,0) and (0,1) are saddle points, and stationary points 
(pi, qi) with I € {5, 8} do not exist, as either the value 
of pi or of qi lies outside the range [0,1], thereby violating 
the normalization conditions. 

If B < and C > 0, we have an equilibrium selection 
problem [23] and find: 

• (0,1) and (1,0) are always asymptotically stable fix 
points. 

• (0,0) is a stable fix point for \C\/\B\ < min[//(l - 
/),(! -/)//]• 

• (1,1) is a stable fix point for |C|/|B| > max[//(l — 
/),(! -/)//]• 

If B > and C < we have: 

• (1,0) and (0,1) are always unstable fix points. 

• (0,0) is a stable fix point for |C|/|B| > max[//(l - 
/),(! -/)//]• 

• (1,1) is a stable fix point for |C|/|B| < min[//(l - 
/),(! -/)//]• 

Moreover, if B and C have different signs, stationary 
points (puqi) with I 6 {5, ...,8} may occur: 

• (p 5 ,0) is a fix point for \C\/(\B\ + \C\) < /, i.e. 
\C\/\B\ <//(l-/). 

• (p 6 ,l) is a fix point for \B\/(\B\ + \C\) < /, i.e. 
\C\/\B\>(1 -/)//. 

• (l,q 7 ) is a fix point for \C\/(B + \C\) > f, i.e. 
\C\/\B\ >//(l-/). 

• (0,g 8 ) is a fix point for \B\/{\B\ + |C|) > /, i.e. 
|C|/|B|<(1 -/)//. 

A. Phase Transitions Between Different Types of 
System Dynamics 

It is natural that a change in the parameters B, C, 
and / causes changes in the system dynamics. Normally, 
small parameter changes will imply smooth changes in 
the locations of fix points, their eigenvalues, the vector 
fields, and basins of attraction. However, when certain 



"critical" thresholds are crossed, new stable fix points 
may show up or disappear in remote places of the pa- 
rameter space, which defines a dis continents (first-order) 
phase transition. If the locations of the stable fix points 
change continuously with a variation of the model pa- 
rameters, while the related "dislocation speed" changes 
discontinously when crossing certain thresholds, we will 
talk of a second-order phase transition. In Figs. [T] to [5] 
continuous transitions are indicated by solid lines, while 
discontinous transitions are represented by dashed lines. 

Analyzing the eigenvalues of the fix points (0,0), (1,0), 
(0,1), and (1,1), it is obvious that our model of two pop- 
ulations with conflicting interactions shows phase tran- 
sitions, when B or C changes from positive to negative 
values or vice versa. The stationary point (0,0) is sta- 
ble for B < and C < 0, (1,0) and (0,1) are stable for 
B < and C > 0, and (1,1) is stable for B > and 
C > 0. This implies completely different types of system 
dynamics, and the transitions between these cases are 
discontinous (corresponding to first-order phase transi- 
tions). For B > and C < 0, the stable fix point differs 
from the corner points (0,0), (1,0), (0,1), and (1,1), but 
its location changes continuously, as B or C crosses the 
zero line (corresponding to a second-order transition). 

It is striking that conflicting interactions between two 
populations lead to further transitions, as / or |C|/|-B| 
cross certain critical values: Namely, as |C| is increased 
from to high values, apart from (0,0), (0,1), (1,0), and 
(1,1), we find the following stationary points (given that 
B and C have different signs): 

• (p 5 ,0) and (0,9 8 ), if / > 1/2 and |C|/|B| < (1 - 
/)// or if / < 1/2 and |C|/|B| < //(l - /). 

. (p 5 ,0) and (p 6 ,l), if / > 1/2 and (1 - /)// < 
\C\/\B\ <//(l-/),or(l,<z 7 )and (0, ?8 ) if / < 1/2 
and //(1-/)<|C|/|B|<(1 -/)//. 

. ( P6 , 1) and (1, q 7 ), if / > 1/2 and \C\/\B\ > //(l - 
/) or if / < 1/2 and |C|/|£?| > (1 - /)//. 

For B < < C, these fix points are unstable or saddle 
points, while they are stable or saddle points for C < 
< B. When the equality sign in the above inequalities 
applies, fix points (pi,qi) with I £ {5, 6, 7, 8} may become 
identical with (0,0), (0,1), (1,0), or (1,1). 

Obviously, there are further transitions to a qualita- 
tively different system behavior at the points |C|/|-B| = 
(1 - /)// and = //(l - /) (see Figs. 3 to 5). 

These are continuous, if B > and C < 0, but discon- 
tinuous for B < and C > 0. Moreover, there is another 
transition, when |C| crosses the value of \B\, as the stabil- 
ity properties of pairs of fix points are then interchanged 
(see Figs. 3-5 and Movie 3 fl]). If B < and C > 0, 
this transition is of second order, as the stable fix points 
remain unchanged as the model parameters are varied 
(see Fig. 4). However, for B > and C < 0, the tran- 
sition is discontinuous (i.e. of first order), because the 
stable fix point turns into an unstable one and vice versa 
(see Fig. 5). That can be followed from the fact that the 



dynamic system behavior and final outcome for the case 
\B\ > \C\ can be derived from the results for \B\ < \C\. 
This is done by applying the transformations B -R- — C, 
p «-> (1 — p), and q «-> (1 — (7), which do not change the 
game-dynamical equations 

^ - p(l-p)[Bf(l-p)+Cfp+C(l-f)(l-q)+B(l-f)q] 

(36) 

and 

^ = ? (l-g)[B(l-/)(l-g)+C7(l-/) g +C/(l-p)+fl/p] . 



(v) (l-/)//<|C|/|B|<l, 

(vi) 1 < \C\/\B\ < f/(l - f) (see Figs. 4+5). 

That is, the system behavior for conflicting interactions 
(see Fig. 3) is clearly richer than for the one-population 
case [U [53] or for two-population cases without interac- 
tions (see Fig. 1) or without self- interactions (see Fig. 2). 
If BC < 0, the system dynamics additionally depends on 
the values of / and |C|/|£?|. It may furthermore depend 
on the initial condition, if B < and C > (see Figs. 
3+4). 
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Figure 4: (Color Online) Illustration of the parameter- 
dependent types of outcomes in the multi-population stag- 
hunt game, if |C|/|-B| and/or / are varied and interaction 
between populations as well as self-interactions are consid- 
ered. The representation and grey shades (colors) are the same 
as in Fig. 3. Solid red lines indicate the thresholds at which 
continuous phase transitions take place, dashed lines indicate 
discontinous phase transitions. 



B. Classification and Interpretation of Different 
Types of System Dynamics 

We have seen that the stability of the stationary points 
and the system dynamics change, when B or C cross 
the zero line. Therefore, it makes sense to distinguish 
four "archetypical" types of games. Note, however, that 
the two types with BC < can be subdivided into six 
subclasses each given by 

(i) //(1-/)<|C|/|B|<1, 

(ii) 1<|C|/|5|<(1 -/)//, 

(hi) |C|/|B|<min(//(l-/),(l -/)//), 
(iv) |£7|/|B| >max(//(I -/),(! -/)//), 
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Figure 5: (Color Online) Illustration of the parameter- 
dependent types of outcomes in the multi-population snow- 
drift game, if |C|/|B| and/or / are varied and interaction be- 
tween populations as well as self-interactions are considered. 
The representation and grey shades (colors) are the same as 
in Fig. 3. 

While our previous analysis has been formal and ab- 
stract, we will now discuss our results in the context of so- 
cial systems for the sake of illustration. Then, the entities 
are individuals, and the states represent behaviors. With- 
out loss of generality, we assume R > P (determining 
the numbering and meaning of behaviors) and / > 1/2 
(determining the numbering of populations such that the 
power of population 1 is the same or greater than the one 
of population 2). Moreover, we will use the following ter- 
minology: If two interacting individuals show the same 
behavior, we will talk about "coordinated behavior" . The 
term "preferred behavior" is used for the preferred coor- 
dinated behavior, i.e. the behavior which gives the higher 
payoff, when the interaction partner shows the same be- 
havior. This payoff is represented by i?, while the non- 
preferred coordinated behavior results in the payoff P. 
Furthermore, if a focal individual chooses its preferred 
behavior and the interaction partner chooses a different 
behavior, the first one receives the payoff S and the sec- 
ond one the payoff T. In the so-called prisoner's dilemma, 
R usually stands for "reward" , T for "temptation" , P for 



9 



"punishment", and S for "sucker's payoff". The payoff- 
dependent parameter C = R — T may be interpreted 
as gain of coordinating on one's own preferred behav- 
ior (if greater than zero, otherwise as loss). Moreover, 
B = S — P may be interpreted as gain when giving up 
coordinated, but non-preferred behavior. 

The conflict of interest between two populations is re- 
flected by the fact that "cooperative behavior" is a matter 
of perspective: A behavior that appears cooperative to a 
focal individual is cooperative from the viewpoint of its 
interaction partner only, if belonging to the same popula- 
tion, otherwise it is non-cooperative from the interaction 
partner's viewpoint. In the model studied in this paper, 
population 1 prefers behavior 1, population 2 behavior 
2. Moreover, behavior 1 corresponds to the cooperative 
behavior from the viewpoint of population 1, but to the 
non-preferred behavior of the interaction partner, i.e. it 
is non-cooperative from the point of view of population 2. 
Moreover, if two interacting individuals display the same 
behavior, their behavior is coordinated. Finally, we speak 
of a "behavioral norm" or of "normative behavior", if all 
individuals (or the great majority) show the same (coor- 
dinated) behavior [6LH64] , independently of their behav- 
ioral preferences and the (sub-)population they belong 
to. It should be stressed that this requires the individ- 
uals belonging to one of the populations to act against 
their own preferences. See Ref. |HD] for the related social 
science literature. 

Within the context of the above definition, the four 
types of system dynamics distinguished above are related 
to four types of games discussed in the following: 

1. For T > R > P > S we have a multi-population 
prisoner's dilemma (MPD), which corresponds to 
the case B < and C < 0. According to the results 



in Sec. IV this is characterized by a breakdown of 
cooperation. Accordingly, individuals in both pop- 
ulations will end up with their non-preferred be- 
havior. This is even true, when the non-negative 
parameter v in the generalized replicator equations 
(17 1 and (18) is different from 1. 



2. In contrast, for R > T > S > P we have a multi- 
population harmony game (MHG) with B > and 
C > 0. In this case, all individuals end up with 
their preferred behaviors, but the behavior of both 
populations is not coordinated. Considering this co- 
existence of different behaviors, one could say that 
each population forms its own "subculture" . 

3. For R > T > P > S, which implies B < and 
C > 0, we are confronted with a multi-population 
stag-hunt game (MSH). For most initial conditions, 
the system ends up in the stationary states (1,0) or 
(0,1). In the first case, both populations coordinate 
themselves on the behavior preferred by popula- 
tion 1, while in the second case, they coordinate 
themselves on the behavior preferred by popula- 
tion 2. In both cases, all individuals end up with 



the same behavior. In other words, they establish a 
commonly shared behavior (a "social norm" ) . How- 
ever, there are also conditions under which differ- 
ent behaviors coexist, namely if (1,1) or (0,0) is a 
stable stationary point (see yellow and red basins 
of attraction in Fig. 4 and in the MSH section of 
Fig. 3). Under such conditions, norms are not self- 
enforcing, as a commonly shared behavior may not 
establish. This relevant case can occur only, if both 
populations have interactions and self-interactions. 
It should also be noted that norms have a simi- 
lar function in social systems that forces have in 
physics. They guide human interactions in subtle 
ways, creating a self-organization of social order. 
See Refs. [5U1 [5U] for a more detailed discussion of 
these issues. 

4. If T > R > S > P, corresponding to B > and 
C < 0, we face a multi-population snowdrift game 
(MSP)). In this case, it can happen that individu- 
als in one of the populations (the stronger one) do 
not coordinate among each other. While some of 
their individuals show a cooperative behavior, the 
others are non-cooperative. We consider this frag- 
mentation phenomenon as a simple description of 
social polarization or conflict. 

Note that, in the multi-population snowdrift game with 
B > and C < 0, the stationary point (p5,0) ex- 
ists for / > \C\/(\B\ + \C\), and the point (p 6 , 1) for 
/>| J B|/(|S| + |C|).If/>l/2and(l-/)//<|C|/|S| < 
//(l - /), (ps,0) is a stable fix point for \B\ < \C\, 
while (pq,1) is a stable fix point for \B\ > \C\, which 
implies a discontinuous transition at the "critical" point 
\B\ = |C|, when \C\ is continuously changed from values 
smaller than \B\ to values greater than \B\ or vice versa. 
This transition, where all individuals in the weaker pop- 
ulation suddenly turn from cooperative behavior from 
the perspective of the stronger population to their own 
preferred behavior, may be considered to reflect a "rev- 
olution" . In the history of mankind, such revolutionary 
transitions have occured many times [65] . 

It turns out to be insightful to determine the average 
fraction of cooperative individuals in both populations 
from the perspective of the stronger population 1. When 
(p5, 0) is the stable stationary point, it can be determined 
as the fraction of cooperative individuals in population 1 
times the relative size / of population 1, plus the fraction 
1 — q 5 = 1 of non-cooperative individuals in population 2 
(who are cooperative from the point of view of population 
1), weighted by its relative size (1 — /): 

-»)■(!-/) = Bf f t c{ l:J ) -f+Hi-f) 



(B - C)f 
B \B\ 



B-C 



\B\ + \C\ 



(38) 



Similarly, if (p 6 , 1) is the stable stationary point, the frac- 
tion of cooperative individuals from the point of view of 
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the stronger population 1 is given by 

PB'/+(l-«te)'(l-/) - , D ^7 -/ + 0-(l-/) 



B-C |B| + |C|' v ' 

as for ge = 1) everybody in population 2 behaves non- 
cooperatively from the perspective of population 1. Sur- 
prisingly, the average fraction of cooperative individu- 
als in both populations from the point of view of the 
stronger population corresponds exactly to the fraction 
Po = \B\/(\B\ + |C|) of cooperative individuals expected 
in the one-population snowdrift game [23] . However, this 
comes with an enormous deviation of the fraction q of 
cooperative individuals in the weaker population 2 from 
the expected value po (as we either have q — or 
g = l), and also with some degree of deviation of p 
from po in the stronger population 1. That is, although 
the stronger population in the multi-population snow- 
drift game causes an opposition of the weaker population 
and a polarization of society |66j , the resulting distribu- 
tion of behaviors in both populations finally reaches a 
result, which fits the expectation of the stronger popu- 
lation 1 (namely of having a fraction p$ of cooperative 
individuals from the point of view of population 1). One 
could therefore say that the stronger population controls 
the behavior of the weaker population. 

V. SUMMARY AND OUTLOOK 

In this paper, we have used multi-population repli- 
cator equations to describe populations with conflict- 
ing interactions and different power. It turns out that 
the system's behavior is much richer than in the one- 
population case or in the two-population case without 
self-interactions. Nevertheless, it is useful to distinguish 
four different types of games, characterized by a qualita- 
tively different system dynamics: The harmony game, the 
prisoner's dilemma, the stag- hunt game and the snow- 
drift game. When applied to social systems, the latter 
three describe social dilemma situations. However, in 
the presence of multiple populations, we may not only 
have the dilemma that people may choose not to coop- 
erate. Their behaviors in different populations may also 
be uncoordinated. Accordingly, the establishment of co- 
operation is only one challenge in social systems, while 
the establishment of commonly shared behaviors ( "social 
norms") is another one. Note that the evolution of social 
norms is highly relevant for the evolution of language 
and culture [HI E3 EH]- According to our model, it is 
expected to occur for multi-population stag hunt inter- 
actions. Interestingly, compared to the multi-population 



games without self-interactions, we have found several 
new subclasses, depending on the power / of populations 
and the quotient |C|/|B| of the payoff-dependent param- 
eters B and C. The same is true for multi-population 
snowdrift games. 

Considering the simplicity of the model, the possible 
system behaviors are surprisingly rich. Besides the oc- 
currence of phase transitions when B and C change their 
sign, we find additional transitions when BC < and 
the quotient |C|/|-B| crosses the values of 1, //(l — /), 
or (1 — /)//. We expect an even larger variety of sys- 
tem behaviors, if the model parameters are not chosen in 
a homogeneous way. For example, one could investigate 
cases in which both populations play different games. 
Our model can also be extended to study cases of mi- 
gration and group selection. This will be demonstrated 
in forthcoming publications. It will also be interesting to 
compare the behavior of test persons in game-theoretical 
lab experiments [68, 69] with predictions of our model 
for interacting individuals with conflicting interests. De- 
pending on the specification of the interaction payoffs, 
it should be possible to find the following types of sys- 
tem behaviors: (1) The breakdown of cooperation, (2) 
the coexistence of different behaviors (the establishment 
of "subcultures"), (3) the evolution of commonly shared 
behaviors ( "norms" ) , and (4) the occurence of social po- 
larization. In the latter case, one should also be able to 
find a "revolutionary transition" as |£?|/|C| crosses the 
value of 1. While there is empirical evidence that all these 
phenomena occur in real social systems, it will be inter- 
esting to test whether the above theory has also predictive 
power. 
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